Open Access 



Research 



BMJ Open 



To cite: Cramm JM, 
Strating MMH, Nieboer AP. 
The role of team climate in 
improving the quality of 
chronic care delivery: a 
longitudinal study among 
professionals working with 
chronically ill adolescents in 
transitional care programmes. 
BMJ Open 2014;4:e005369. 
doi:1 0.1 1 36/bmjopen-201 4- 
005369 

► Prepublication history for 
this paper is available online. 
To view these files please 
visit the journal online 
(http://dx.doi.org/10.1136/ 
bmjopen-201 4-005369). 



Received 1 April 2014 
Revised 29 April 2014 
Accepted 30 April 2014 



CrossMark 



Institute of Health Policy and 
Management, Erasmus 
University Rotterdam, 
Rotterdam, The Netherlands 



Correspondence to 

Dr Jane Murray Cramm; 
cramm@bmg.eur.nl 




The role of team climate in improving 
the quality of chronic care delivery: a 
longitudinal study among professionals 
working with chronically ill adolescents 
in transitional care programmes 

Jane M Cramm, Mathilde M H Strating, Anna P Nieboer 



ABSTRACT 

Objectives: This study aimed to (1) evaluate the 
effectiveness of implementing transition programmes in 
improving the quality of chronic care delivery and 
(2) identify the predictive role of (changes in) team 
climate on the quality of chronic care delivery over time. 
Settings: This longitudinal study was undertaken with 
professionals working in hospitals and rehabilitation 
units that participated in the transition programme 'On 
Your Own Feet Ahead!' in the Netherlands. 
Participantss: A total of 145/180 respondents 
(80.6%) filled in the questionnaire at the beginning of 
the programme (T1), and 101/173 respondents (58.4%) 
did so 1 year later at the end of the programme (T2). A 
total of 90 (52%) respondents filled in the questionnaire 
at both time points. Two-tailed, paired t tests were used 
to investigate improvements overtime and multilevel 
analyses to investigate the predictive role of (changes 
in) team climate on the quality of chronic care delivery. 
Interventions: Transition programme. 
Primary outcome measures: Quality of chronic care 
delivery measured with the Assessment of Chronic 
Illness Care Short version (ACIC-S). 
Results: The overall ACIC-S score at T1 was 5.90, 
indicating basic or intermediate support for chronic care 
delivery. The mean ACIC-S score at T2 significantly 
improved to 6.70, indicating advanced support for 
chronic care. After adjusting for the quality of chronic 
care delivery at T1 and significant respondents' 
characteristics, multilevel regression analyses showed 
that team climate at T1 (p<0.01) and changes in team 
climate (p<0.001) predicted the quality of chronic care 
delivery at T2. 

Conclusions: The implementation of transition 
programmes requires a supportive and stimulating team 
climate to enhance the quality of chronic care delivery to 
chronically ill adolescents. 



BACKGROUND 

The importance of improving the quality of 
chronic care delivery to adolescents with 
chronic conditions has been increasingly 



Strengths and limitations of this study 



■ The first strength of this study is the longitudinal 
design to assess the predictive role of (changes 
in) team climate on the quality of chronic care 
delivery over time. 

■ The second strength of the study is the evalu- 
ation of a programme to improve transitional 
care for adolescents with a variety of conditions, 
not just a single condition. 

■ The most important limitation of this study is 
that we did not investigate the predictive role of 
(changes in) team climate on the quality of 
chronic care delivery over time among profes- 
sionals not participating in a quality improvement 
programme. Although we found that the quality 
of chronic care delivery improved over time after 
the implementation of a combination of transi- 
tional interventions and participation in a quality 
improvement programme, we do not know 
whether this improvement was larger than in 
teams not enrolled in such a programme or 
compared with the implementation of a single 
intervention. 

■ The second limitation is that other factors may 
additionally explain the improved quality of care 
delivery such as the unmet education and train- 
ing needs of professionals, lack of organisational 
and management support and the quality of 
communication and coordination between pro- 
fessionals. Future research is necessary to 
unravel their predictive nature for quality of care. 

■ The third limitation is that our findings provide 
no insight into which (set(s) of) intervention(s) 
had the greatest impact on quality of care. 



acknowledged, 1-7 leading to the develop- 
ment of transitional care to bridge the gap 
between paediatric and adult care. 8-12 Blum 
et aH defined the transition of care as the 
purposeful, planned movement of adoles- 
cents and young adults with chronic physical 
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and medical conditions from child-centred to adult- 
oriented healthcare systems. This transition involves a 
multifaceted, active process attending to the medical, 
psychosocial, educational and vocational needs of chron- 
ically ill adolescents. Research has shown that the deliv- 
ery of effective and high-quality chronic care requires 
comprehensive system changes that entail more than 
simply implementing interventions or adding features to 
the existing acute-focused system. 13-15 Many adolescents, 
however, have reported poor experiences with transi- 
tional care delivery, 16 resulting in stress and anxiety. 
Furthermore, negative experiences with chronic care 
delivery are expected to result in suboptimal use of care, 
non-compliance to treatment and loss to follow-up. 17 18 

Wagner et al 19 developed the chronic care model to 
guide quality improvement in chronic care delivery and 
the shift to care that is organised, structured, planned, 
patient centred and proactive through a combination of 
effective multidisciplinary teams and planned interac- 
tions with patients. The four core elements of the model 
within healthcare organisations are (1) self-management 
support, (2) delivery system design, (3) decision support 
for professionals and (4) the use of patient registries 
and other supportive clinical information systems. 19 20 
Self-management support refers to collaboratively helping 
patients and families to acquire the skills and confidence 
to self-manage a chronic condition, 21 which is also con- 
sidered an essential element of transitional care. 22 In 
case of transitional care, it is important to focus on 
building the capacity of chronically ill adolescents to 
engage in a developmentally appropriate level of self- 
management of their condition. Examples of adolescent- 
specific interventions are use of a self-management tool 
to assess transfer readiness, 22 23 implementing an indi- 
vidual transition plan (ITP) and challenging adolescents 
to attend consultations independently (without parents 
present). 24 Delivering high-quality chronic illness care 
demands planning and the coordinated actions of pro- 
fessionals not only from various disciplines, such as 
between nurses, medical doctors and physical therapists, 
but also between paediatric and adult professionals in 
the case of transitional care. Planned visits and regular 
follow-up with these multiple professionals are essential 
within the delivery system design to effectively monitor and 
manage the chronic condition. 14 15 Designing and 
implementing a transition (outpatient) clinic is expected 
to improve multidisciplinary collaboration between 
paediatric and adult care. 24 Another example is appoint- 
ing a transition coordinator in charge of transitional 
care for chronically ill adolescents. 22 24 Clinical proto- 
cols and guidelines (eg, a transition protocol for the 
transition from paediatric to adult care) for optimal 
chronic care delivery are needed and should be inte- 
grated into daily practice to provide decision support for 
professionals. 21 Clinical information systems provide 
support and remind professionals to comply with guide- 
lines and protocols, such as by supplying feedback on 
chronic illness measures (eg, lipid or glucose level) and 



registries for planning individual patient care 15 19 21 in 
an individual treatment and/ or transition plan. 

Evidence clearly shows that care delivery based on the 
chronic care model is effective. Pearson et al, 25 for 
example, found evidence suggesting that the chronic 
care model is a useful framework for quality improve- 
ment. It leads to more positive experiences of quality of 
care delivery as perceived by professionals as well as 
chronically ill patients. 26 In a meta-analysis on evidence 
of the chronic care model, Tsai et af 1 provided strong 
evidence of significant improvements in process 
outcome measures. Others found that it prevents disease 
complications 28 and improves patients' health beha- 
viours. 29 Furthermore, these improvements promote sus- 
tainability of programmes. 30 A recent literature review 
reaffirmed the notion that successful improvement strat- 
egies in chronic disease care are consistent with the 
concept of the chronic care model. 20 No research until 
now, however, has investigated the effectiveness of transi- 
tional care programmes in improving the quality of 
chronic care delivery over time, as described in Wagner's 
chronic care model. 19 Therefore, the first aim of this 
study was to evaluate the effectiveness of implementing 
transition programmes in improving the quality of 
chronic care delivery, as described by the four key ele- 
ments of the chronic care model. 

The quality of chronic care delivery largely depends 
on the existence of prepared and proactive multidiscip- 
linary teams sharing responsibility for the provision of 
care to their patients. 31 Research, however, shows that 
professionals involved in transitional care identify several 
unmet educational and training needs as main barriers 
to provide age-appropriate and developmentally appro- 
priate care to chronically ill adolescents. 32 Well- 
functioning teams comprising professionals from diverse 
backgrounds are at the core of transition programmes, 
who all should have the skills and objectives needed to 
provide high-quality transitional care. One of the most 
important characteristics of such teams is their team 
climate. 33 Research, for example, has shown that team 
climate is related to access to care delivery, patient satis- 
faction and team effectiveness. 34 35 A team's perform- 
ance may be facilitated or hindered by team climate. 33 36 
Team climate refers to professionals' shared knowledge 
and perceptions of the types of behaviour and action 
that are rewarded and supported by the team's policies, 
practices and procedures. 36 Previous research has 
indeed shown that team climate was positively related to 
high-quality care delivery through the sharing of objec- 
tives, commitment and support among professionals. 34 37 
Therefore, we expected that teams whose multidisciplin- 
ary team members agree on objectives and proactively 
participate in decision-making, are committed to achiev- 
ing the highest possible standards of chronic care deliv- 
ery and receive support from other team members 
would be more likely to be able to improve the quality 
of chronic care delivery to chronically ill adolescents. 
The longitudinal relationship between team climate and 
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quality of care delivery to chronically ill adolescents has 
not been studied yet. Therefore, the second aim of this 
study was to investigate the predictive role of team 
climate and changes therein on the quality of chronic 
care delivery over time. 

METHODS 
Setting and design 

This longitudinal study was undertaken with profes- 
sionals working in hospitals and rehabilitation units that 
implemented transition programmes for adolescents 
with chronic conditions in the Netherlands called 'On 
Your Own Feet Ahead!'. 38 " 40 The 'On Your Own Feet 
Ahead!' programme follows the Breakthrough Series 
improvement and implementation strategy. 41 Strong fea- 
tures of this strategy are the efficient use of participating 
experts and the exchange of best practices for improve- 
ment. Key interventions implemented for each adoles- 
cent patient within this programme were: (1) use of a 
transition protocol and joint mission on transitional care 
between paediatric and adult care, (2) appointment of a 
transition coordinator, (3) use of an individual transition 
plan, (4) multidisciplinary consultation on transition 
and/or implementation of a transitional (outpatient) 
clinic and (5) challenging the adolescent to be alone in 
the consultation room. The transition programme was 
implemented in hospitals and rehabilitation centres tar- 
geting several patient populations: adolescents with type 
I diabetes; juvenile rheumatoid arthritis; cystic fibrosis; 
kidney conditions, such as renal insufficiency/kidney 
failure or kidney transplantation; urological conditions, 
such as imperforate anus with malfunctions in the anus, 
rectum, urethra and bladder, or exstrophy of the 
bladder (a congenital anomaly in which part of the 
urinary bladder is present outside the body) ; and neuro- 
muscular disorders (with the use of home ventilation). 
This study was approved by the ethics committee of 
the Erasmus University Medical Centre, Rotterdam, 
the Netherlands. 

Data collection and measures 

Project leaders from 29 teams selected 4 to a maximum 
of 10 team members (depending on the type of setting) 
to fill in the questionnaire used in this study. Team 
members were selected by project leaders based on their 
involvement in transitional care. In rehabilitation centres, 
more team members were involved since in these settings 
more services are involved in care for adolescents. Each 
selected team member received a questionnaire by mail 
at the beginning of the programme (Tl) and 1 year later 
at the end of the programme (T2). A total of 145/180 
respondents (80.6% response rate) representing all 29 
teams filled in the questionnaire at the beginning of the 
programme (Tl), and 101/173 (58.4% response rate) 
representing 27 teams 1 year later at the end of the pro- 
gramme (T2). A total of 90 (52.0%) respondents filled in 
the questionnaire at both time points. 



The Assessment of Chronic Illness Care Short version 
(ACIC-S) is a comprehensive tool developed in line with 
Wagner's chronic care model to assess the quality of 
chronic care delivery. 42 In contrast with traditional 
disease-specific tools, such as the measurement of gly- 
cated haemoglobin levels, productivity measures (eg, 
number of patients seen) or process indicators (eg, per- 
centage of diabetic patients receiving foot examina- 
tions), this instrument evaluates the level and nature of 
improvements made in the quality of chronic care deliv- 
ery. 21 The instrument has been identified as valid for 
assessing the quality of care delivery 42 and valid and sen- 
sitive for tracing changes therein. 43 

The ACIC-S used in this study consists of 12 items cov- 
ering the four key areas of the chronic care model: self- 
management support (n=3), delivery system design 
(n=3), decision support (n=3) and clinical information 
systems (n=3). 40 For each item, respondents selected the 
degree to which four descriptive levels of implementa- 
tion, ranging from 'little or none' to 'fully implemented 
intervention', applied to their programmes. For 
example, with self-management support, the answering 
categories are: ' ... is limited to the distribution of infor- 
mation (pamphlets, booklets)', ... is available by referral 
to self-management classes or educators', ' ... is provided 
by trained clinical educators who are designated to do 
self-management support, are affiliated with each prac- 
tice and see patients on referral', ' ... is provided by clin- 
ical educators affiliated with each practice, trained in 
patient empowerment and problem-solving methodolo- 
gies, and see most patients with chronic illness'. The 
result is a 0-11 scale, with categories defined as 0-2 
(little or no support for chronic care), 3-5 (basic or 
intermediate support), 6-8 (advanced support) and 9- 
11 (optimal or comprehensive chronic care delivery). 
Subscale scores for the areas of the chronic care model 
were derived by calculating the average score for all 
items in each subsection when at least two of three items 
were available. The total quality of chronic care delivery 
score was calculated using the average scores for the 
four subsections (when at least three of four subsections 
were available). In the present study, Cronbach's a of 
the ACIC-S was 0.88 at baseline (Tl) and 0.90 at T2 
(1 year later), indicating reliability. 

The team climate inventory (TCI) was used to 
measure professionals' perceptions of team climate 
while providing care to chronically ill adolescents. The 
questionnaire comprises four broad factors reflecting a 
team's shared perceptions of organisational policies, 
practices and procedures: shared vision and objectives 
(four items) (eg, To what extent do you think your 
team's objectives are clearly understood by other 
members of the team?), participative safety (four items) 
(eg, we have a 'we are in it together' attitude), task 
orientation (three items) (eg, Do members of the team 
build on each other's ideas in order to achieve the best 
possible outcome?) and support for innovation (three 
items) (eg, In this team we take the time needed to 
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develop new ideas.). Participants were asked to rate their 
agreement with each TCI item on a five-point scale 
(l=strongly disagree, 2=disagree, 3=neither agree nor 
disagree, 4=agree and 5=strongly agree). Scores for each 
item in a scale are summed to determine the scale 
score. Higher scores indicated a better or more desirable 
team climate. 44-46 In the present study, Cronbach's a of 
the TCI was 0.89 at baseline (Tl) and 0.95 at T2 (1 year 
later) , indicating reliability. 

Respondents were also asked about personal/team 
characteristics, such as age, gender, occupation, number 
of years working in the organisation and number of 
working hours per week. 

Statistical analyses 

We used descriptive statistics to describe the study popu- 
lation. Two-tailed, paired t tests were used to investigate 
improvements in the quality of chronic care delivery and 
team climate over time. We employed a multilevel 
random-effects model to investigate the predictive role 
of (changes in) team climate on the quality of chronic 
care delivery at T2 while controlling for the quality of 
chronic care delivery at Tl and significant individual 
characteristics (significant at p<0.05 in the univariate 
analyses) (SPSS V.20, mixed models option; SPSS, Inc, 
Chicago, Illinois, USA). 

RESULTS 

Women comprised 82% (of 144) of the respondents at 
Tl. The mean age was 44.34±9.17 (range 24-63) years. 
About half of the respondents (58%) worked more than 
29h/week and 85% had been working in their current 
organisation for more than 3 years. Respondents con- 
sisted of nurses (39%), specialists (31%) (medical 
doctors eg, paediatrician, adolescent medicine specialist, 
rehabilitation specialist) and paramedical professionals 
(7%), social workers (11%), psychologists (5%) and 
manager/ quality officers (7% ) . 

The overall quality of the chronic care delivery 
(ACIC-S) score at Tl was 5.90, indicating basic or inter- 
mediate support for chronic care. Paired t test results 
showed significant improvement in the quality of chronic 



care delivery at T2. The mean ACIC-S score at T2 was 
6.70, indicating advanced support for chronic care. The 
ACIC-S self-management support, decision support and 
clinical information systems subscales yielded similar 
results (table 1). No significant improvement was made 
in the delivery system design; the mean ACIC-S scores for 
this subscale were 7.37 at Tl and 7.64 at T2, both of 
which indicated advanced support for chronic care. In 
addition, no difference in team climate was found over 
time. Furthermore, changes in team climate and quality 
of chronic care delivery did not vary across teams. The 
mean score of team climate of 55.51 at Tl was substan- 
tially higher than Goh et aFs 36 test group score of 50.40 in 
the primary care setting (p<0.001). 

We compared baseline characteristics of the respondents 
who completed both questionnaires to those who com- 
pleted Tl only. No difference in team climate (TCI at Tl) 
or overall quality of chronic care delivery (ACIC Tl) was 
found. 

We employed a multilevel random effects model to 
investigate the predictive role of (changes in) team 
climate on the quality of chronic care delivery at T2 while 
controlling for the quality of chronic care delivery at Tl 
and significant individual characteristics (significant at 
p<0.05 in the univariate analyses). In the univariate ana- 
lyses, age, gender, number of working hours per week 
and number of years working within the organisation 
were not significantly associated with quality of care deliv- 
ery (results not shown). Regarding the respondent's 
occupation, only being a specialist was significantly asso- 
ciated with quality of care delivery (r=0.20; p<0.05). 
Therefore, we only included respondent's occupation in 
the multilevel analyses with the largest group (nurse) as 
the reference category. After adjusting for the quality of 
chronic care delivery at Tl and respondent's occupation, 
multilevel analyses showed that team climate at Tl 
(p<0.01) and changes in team climate (p<0.001) pre- 
dicted the quality of chronic care delivery at T2 (table 2) . 

DISCUSSION 

This study aimed to (1) evaluate the effectiveness of 
implementing transition programmes in improving the 



Tab.e 1 Changes in the quality of chronic care delivery and team climate over time 

Baseline Follow-up 

assessment assessment 

(T1,2010) (T2, 2011) T2-T1 





Mean 


SD 


Mean 


SD 


Mean 


SD 


p Value* 


n 


Overall quality of chronic care delivery (ACIC-S) 


5.90 


(1.48) 


6.70 


(1.20) 


0.79 


(1.70) 


<0.001 


82 


Self-management support (ACIC-S) 


5.35 


(1-79) 


6.91 


(2.42) 


1.57 


(2.36) 


<0.001 


86 


Delivery system design (ACIC-S) 


7.37 


(1.93) 


7.64 


(2.51) 


0.27 


(2.25) 


0.271 


85 


Decision support (ACIC-S) 


5.59 


(2.07) 


6.03 


(2.20) 


0.44 


(2.07) 


<0.05 


82 


Clinical information systems (ACIC-S) 


5.31 


(2.08) 


6.14 


(2.37) 


0.83 


(2.44) 


<0.01 


77 


Team climate (TCI) 


55.51 


(6.09) 


55.91 


(9.01) 


0.40 


(8.94) 


0.689 


82 



'Paired t test, T1 vs T2. 

ACIC-S, assessment of chronic illness care short version; TCI, team climate inventory. 
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Table 2 Predictors of chronic care delivery quality at T2 



(random intercepts model, 


n=78) 










B 


SD 


B 


SE 


uonsxani 


— I .DO 


\ .Of 


O 07*** 

O.O/ 


U.I / 


Quality of chronic care 


U.DO 


U.1 1 


u.yy 


OHO 


aenvery ai 1 1 (aoio-oj 










Specialists 


H H O** 


U.oo 


O A O** 

U.4o 


O H A 
U.14 


P o\ /r» h 1 r\ n i etc 
r byUI lUIUyiolo 


1 OR 
I .UD 


U. / o 


0 17 

U. I / 


U. I c. 


Paramedical 


0.28 


0.67 


0.06 


0.14 


professionals 










Social workers 


0.82 


0.83 


0.19 


0.19 


Manager/quality officer 


0.09 


1.02 


0.01 


0.16 


Team climate at T1 (TCI) 


0.07** 


0.31 


0.44** 


0.17 


Changes in team climate 


0.09*** 


0.22 


0.79*** 


0.17 



(TCI; T2-T1) 

***p< 0.001 ; **p<0.01 (two-tailed). 

Multilevel analyses included only data from respondents who filled 
in questionnaires at T1 and T2. List wise deletion of missing 
cases resulted in the inclusion of 78 cases in multilevel regression 
analyses. The largest occupation group (nurse) is the reference 
category. 

ACIC-S, assessment of chronic illness care short version; TCI, 
team climate inventory; T1=baseline (2010); T2=follow-up (2011). 



quality of chronic care delivery, as described by the four 
key elements of the chronic care model; and (2) identify 
the predictive role of (changes in) team climate on the 
quality of chronic care delivery over time. Although 
expectations for various transitional interventions are 
largely agreed on, empirical evidence describing their 
effectiveness in improving the quality of chronic care 
delivery is lacking. 2 Other studies of chronic care deliv- 
ery (eg, in a primary care setting) have shown that multi- 
component interventions are required to change 
delivery processes and outcomes. 13-15 20 The chronic 
care model, a framework applied in multidisciplinary 
care settings to assess the quality of chronic care delivery, 
aims to transform this delivery from acute and reactive 
to proactive, integrated and personalised. To the best of 
our knowledge, this study was the first to investigate the 
effectiveness of transition programmes in improving the 
quality of chronic care delivery over time, as described 
by Wagner's chronic care model. 19 Our results clearly 
showed significant improvements in the quality of 
chronic care delivery over time, from basic or intermedi- 
ate support to advanced support for chronic care. One 
year after the start of the programme, responses in all 
four areas of the chronic care model as perceived by the 
professionals, as well as the overall quality of chronic 
care delivery, indicated advanced support for chronic 
care. Implementation of these transitional care pro- 
grammes effectively reduced all bottlenecks identified by 
professionals at the start of the programme. 
Improvements were identified in coordination of care, 
access to resources for joint care services, having a joint 
mission, synchronising paediatric and adult treatment 
protocols, organising joint clinics and improving the 
provision of medical and psychosocial information about 



the transition period to patients. Reduction of these 
experienced bottlenecks may explain the improved 
quality of chronic care delivery over time. 

We additionally investigated the predictive role of 
(changes in) team climate on the quality of chronic care 
delivery. We found that after adjusting for the quality of 
chronic care delivery at Tl and significant respondents' 
characteristics, team climate at the start of the pro- 
gramme and changes therein predicted the quality of 
chronic care delivery. These findings support our 
expectation that teams with positive and stimulating 
team climates, in which members share the same objec- 
tives, were better able to improve the quality of chronic 
care delivery. This stresses the importance of creating a 
positive and stimulating team climate among profes- 
sionals from various disciplines. Healthcare professionals 
from different occupational backgrounds are known to 
have their own goals and priorities, 47-49 which may com- 
promise a stimulating team climate and hinder the 
team's ability to improve quality of care delivery. 

While we found that team climate did not improve sig- 
nificantly over time in our study sample, at Tl team 
climate was already substantially higher compared to team 
climate in the primary care setting. 36 Joining the transition 
programme may have led to improved team climate in the 
beginning of the programme but not over time. 

We found that changes in team climate and the 
quality of chronic care delivery did not vary across teams 
targeting different patient populations (adolescents with 
type I diabetes, juvenile rheumatoid arthritis, cystic fibro- 
sis, kidney conditions, urological conditions and neuro- 
muscular disorders), suggesting that these mechanisms 
apply to all teams regardless of their patient population. 

CONCLUSIONS 

The implementation of transition programmes improves 
the quality of chronic care delivery as described by the 
chronic care model. Such implementation requires a 
supportive and stimulating team climate to enhance the 
quality of chronic care delivery to chronically ill adoles- 
cents in hospitals and rehabilitation centres. 
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